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SPECIFICATION 

TITLE OF THE INVENTION 

Method and apparatus for generating check matrix 

5 

TECHNICAL FIELD 

The present invention relates to a method and an apparatus for 
generating a check matrix for a low density parity check (LDPC) code 
that is employed as an error correcting code, and more particularly, to a 
10 method and an apparatus for generating a check matrix capable of 
searching a definite and characteristic stabilized check matrix for the 
LDPC code. 



BACKGROUND ART 

15 A conventional method of generating a check matrix for an 

LDPC code will be explained below. Fig. 13 illustrates an LDPC 
encoding/decoding system. Reference numeral 101 denotes an 
encoder, 102 denotes a modulator, 103 denotes a channel, 104 
denotes a demodulator, and 105 denotes a decoder. Prior to 

20 explanation of a conventional method of generating check matrixes for 
LDPC codes, eincoding and decoding using LDPC codes are explained 
first. 

At the sending side, the encoder 101 generates a check matrix 
H using a certain method. Then, a generator matrix G is derived from 
25 the following condition. 
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G:k*n matrix (where k is information-length and n is code-word 
length) , 

GH T =0 (where T is transposition) 

The encoder 101 then receives a message (itm m 2 ... m k ) of an 
5 information-length k, and generates a code-word C using the generator 
matrix G as follows: 

C=(rrii ni2 ... rhk)G 

=(ci c 2 ... c n ) (where H(ci c 2 ... c n ) T =0). 
The modulator 102 subjects the generated code-word C to 
10 digital modulation such as BPSK, QPSK or multi-valued QAM and 
transmits the resultant modulated signal. 

At the receiving side, the demodulator 104 receives the 
modulated signal via the channel 103, and subjects it to a digital 
demodulation such as BPSK, QPSK or multi-valued QAM. The 
15 decoder 105 then subjects the LDPC-coded, demodulated result to an 
iterative decoding by "Sum-Product Algorithm" and provides an 
estimated result (corresponding to the original mi m 2 ... m k ). 

Conventionally, check matrixes for the LDPC codes are 
generated as explained below. As the check matrix the LDPC code, 
20 for example, following matrix is proposed by Gallager (see Non-patent 
Literature 1, Fig. 14). 

This matrix is a binary matrix of "1" and "0". Parts of "1" are 
hatched and parts of "0" are white. There are four "1"s in one row 
(hereinafter, "row weight"), and there are three "1"s in one column 
25 (hereinafter, "column weight"). All columns and rows have respective 
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uniform weights. Thus, it is generally called "Regular-LDPC Code". 
In the Gallager's codes, as shown in Fig. 14, the matrix is divided into 
three blocks, for example, and the second and third blocks are 
subjected to random permutation. 
5 Because the random permutation has no certain rule, it is 

required to execute a time-consuming search by computer to find codes 
with a better characteristic. 

Euclidean geometry codes are such LDPC codes that exhibit a 
relatively stable and nice characteristic and can definitely generate a 
10 matrix without the use of the computer search. Y. Kou et al. have 
proposed a method using such Euclidean geometry codes. This 
method explains "Regular-LDPC Codes" consisting of regular 
ensembles (see Non-patent Literature 2). 

A method of generating a check matrix for LDPC codes is herein 
15 proposed using Euclidean geometry codes EG(2, 2 6 ) or a kind of finite 
geometric codes. This method achieves a characteristic that is located 
closely but 1.45 decibels away from the Shannon limit at an error rate 
of 10-4. Fig. 15 illustrates a configuration of Euclidean geometry 
codes EG(2, 2 2 ), which has a structure of "Regular-LDPC Codes" with 
20 row and column weights of 4, 4. 

Euclidean geometry codes EG(m, 2 s ) have a characteristic 
defined as follows 
Code length: n=2 2s -1 
Redundant bit length: n-k=3 s -1 
25 Information length: k=2 2s -3 s 
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Minimum distance: dmin=2 s, + 1 
Density: r=2 s 7(2 2s -1). 

As can be seen from Fig. 15, Euclidean geometry codes have a 
structure with a cyclically sifted location of "1" in each row from an 
5 adjacent row. This structure can characteristically configure codes 
easily and definitely. 

The check matrix generating method by Y. Kou et al. further 
includes changing row and column weights based on the Euclidean 
geometry codes to extend rows and columns, if required. For example, 
10 when a column weight in EG(2, 2 2 ) is separated into halves, in the 
paper by Y. Kou et al., every other one of four weights located in one 
column is separated into two groups. Fig. 16 illustrates an exemplary 
regular separation of the column weight from 4 into 2. 

On the other hand, Ludy et al. have reported that 
15 "Irregular-LDPC Codes" have a better characteristic than that of 
"Regular-LDPC Codes" (see Non-patent Literature 3). The 
"Irregular-LDPC Codes" represent such LDPC codes that have 
non-uniformity in either or both of row and column weights. 

Richardson et al. have analyzed it theoretically (see Non-patent 
20 Literature 4) as well as Chung et al. (see Non-patent Literature 5). 

In particular, Chung et al. analyze a "Sum-Product Algorithm" for 
LDPC codes, on the assumption that a log-likelihood-ratio (LLR) 
between an input and an output at an iterative decoder can be 
approximated in a Gaussian distribution, to derive a nice ensemble of 
25 row and column weights. 
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described) and the number of "1" points in a column (corresponding to 
a degree distribution of check nodes later described) are both 
employed as variables to derive the degree distribution of variable 
nodes and the degree distribution of check nodes that can maximize 
5 the following equation (1) (rate: coding rate). In a word, a linear 
programming is employed to search an ensemble that minimizes a 
signal-to-noise ratio (SNR). 

rate =i-jfpW (1) 

Therefore, a problem arises because a check matrix derived 
10 from the maximum of the "rate" has a flux and unstable characteristic. 
In addition, the conventional method of generating check matrixes for 
LDPC codes iteratively executes the derivation of the degree 
distribution of variable nodes and the derivation of the degree 
distribution of check nodes over certain times. Therefore, a problem 
15 arises because it takes time to some extent for searching. 

The present invention has been achieved in consideration of the 
above problems, and accordingly has an object to provide a method 
and an apparatus for generating a check matrix of a satisfactory 
performance for the an LDPC code capable of easily searching a 
20 definite and characteristic stabilized check matrix for the LDPC code 
corresponding to an optional ensemble. 



DISCLOSURE OF THE INVENTION 

A method of generating a check matrix for a low-density 
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parity-check code in which at least one of weights of a column and a 
row are not uniform, using a Euclidean geometry code, according to 
one aspect of the present invention includes determining a code length 
and a coding rate; selecting the Euclidean geometry code that becomes 
5 a base; rearranging the Euclidean geometry code selected, based on a 
specific relational equation to create a basic matrix; selecting a 
maximum value of the weight of the column that satisfies a condition of 
"2<maximum value of the weight of the column<number of 1s within 
columns in the Euclidean geometry code"; searching provisionally an 

10 ensemble of the weights of the row and the column weights of the 
low-density parity-check code via optimization based on Gaussian 
approximation in a state that number of the weights of the row are 
limited to continuous two kinds to determine an optimum set of the 
weights of the row; deleting the rows sequentially from a bottom of the 

15 basic matrix considering number of rows after a division; searching 
provisionally an ensemble of the weights of the row and the column of 
the low-density parity-check code via optimization based on Gaussian 
approximation, using the set of the weights of the row as a fixed 
parameter, to determine an optimum set of the weights of the column; 

20 searching an optimal ensemble of the weights of the row and the 

column of the low-density parity-check code via optimization based on 
Gaussian approximation, using the set of the weights of the row and 
the column as a fixed parameter; and dividing at random the weights of 
the row apd the column of the basic matrix after deleting the rows in a 

25 predetermined procedure based on a final ensemble. 
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According to the method according to the present invention the 
specific relational equation used at the rearranging is generated such 
that the weights within the matrix are arranged at a higher position 
within columns. 

5 A method of generating a check matrix for a low-density 

parity-check code in which at least one of weights of a column and a 
row are not uniform, using a Caylay graph, according to another aspect 
of the present invention includes determining a code length and a 
coding rate; determining the weights of the row and the column in the 

10 Caylay graph, which becomes a base, to create a basic matrix; 

selecting a maximum value of the weight of the column that satisfies a 
condition of "2<maximum value of the weight of the column<number of 
1s within columns in the Caylay graph"; searching provisionally an 
ensemble of the weights of the row and the column weights of the 

15 low-density parity-check code via optimization based on Gaussian 
approximation in a state that number of the weights of the row are 
limited to continuous two kinds to determine an optimum set of the 
weights of the row; deleting the rows sequentially from a bottom of the 
basic matrix considering number of rows after a division; searching 

20 provisionally an ensemble of the weights of the row and the column of 
the low-density parity-check code via optimization based on Gaussian 
approximation, using the set of the weights of the row as a fixed 
parameter, to determine an optimum set of the weights of the column; 
searching an optimal ensemble of the weights of the row and the 

25 column of the low-density parity-check code via optimization based on 
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Gaussian approximation, using the set of the weights of the row and 
the column as a fixed parameter; and dividing at random the weights of 
the row and the column of the basic matrix after deleting the rows in a 
predetermined procedure based on a final ensemble. 
5 According to the method according to the present invention, in 

the Gaussian approximation, the optimal ensemble of the weights of the 
row and the column, which minimizes a threshold, is searched in a 
single linear programming such that a Gaussian noise becomes 
maximum in a state that the coding rate is fixed. 

10 According to the method according to the present invention, at 

the searching the optimum ensemble of the row and the column of the 
low-density parity-check code, a weight distribution in the ensemble is 
adjusted such that a total number of the weights in weight unit is equal 
to an integer and a sum of the total number of the weights in the weight 

15 unit is equal to a total number of 1s in the Euclidean geometry code. 
At the dividing, the dividing is performed based on the ensemble after 
an adjustment. 

According to the method according to the present invention, 
wherein at the dividing, a Latin square of basic random sequence is 
20 generated, and a weight of 1 is extracted from each of the rows and 
each of the columns in the basic matrix after deleting the row, thereby 
dividing each of the rows and each of the columns at random based on 
the Latin square. 

An apparatus for generating a check matrix for a low-density 
25 parity-check code in which at least one of weights of a column and a 
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row are not uniform, using a Euclidean geometry code, according to still 
another aspect of the present invention includes a 

code-length/coding-rate determining unit that determines a code length 
and a coding rate; a Euclidean geometry code selecting unit that 
5 selects the Euclidean geometry code that becomes a base; a 

rearranging unit that rearranges the Euclidean geometry code selected, 
based on a specific relational equation to create a basic matrix; a 
maximum-weight selecting unit that selects a maximum value of the 
weight of the column that satisfies a condition of "2<maximum value of 

10 the weight of the column<number of 1s within columns in the Euclidean 
geometry code"; a first weight searching unit that searches 
provisionally an ensemble of the weights of the row and the column 
weights of the low-density parity-check code via optimization based on 
Gaussian approximation in a state that number of the weights of the 

15 row are limited to continuous two kinds to determine an optimum set of 
the weights of the row; a deleting unit that deletes the rows sequentially 
from a bottom of the basic matrix considering number of, rows after a 
division; a second searching unit that searches provisionally an 
ensemble of the weights of the row and thecolumn of the low-density 

20 parity-check code via optimization based on Gaussian approximation, 
using the set of the weights of the row as a fixed parameter, to 
determine an optimum set of the weights of the column; a third 
searching unit that searches an optimal ensemble of the weights of the 
row and the column of the low-density parity-check code via 

25 optimization based on Gaussian approximation, using the set of the 
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weights of the row and the column as a fixed parameter; and a dividing 
unit that divides at random the weights of the row and the column of the 
basic matrix after deleting the rows in a predetermined procedure 
based on a final ensemble. 
5 An apparatus for generating a check matrix for a low-density 

parity-check code in which at least one of weights of a column and a 
row are not uniform, using a Caylay graph, according to still another 
aspect of the present invention includes a code-length/coding-rate 
determining unit that determines a code length and a coding rate; a 

10 Caylay-graph determining unit that determines the weights of the row 
and the column in the Caylay graph, which becomes a base, to create a 
basic matrix; a maximum-weight selecting unit that selects a maximum 
value of the weight of the column that satisfies a condition of 
"2<maximum value of the weight of the column<number of 1s within 

15 columns in the Caylay graph"; a first weight searching unit that 

searches provisionally an ensemble of the weights of the row and the 
column weights of the low-density parity-check code via optimization 
based on Gaussian approximation in a state that number of the weights 
of the row are limited to continuous two kinds to determine an optimum 

20 set of the weights of the row; a deleting unit that deletes the rows 

sequentially from a bottom of the basic matrix considering number of 
rows after a division; a second searching unit that searches 
provisionally an ensemble of the weights of the row and the column of 
the low-density parity-check code via optimization based on Gaussian 

25 approximation, using the set of the weights of the row as a fixed 
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parameter, to determine an optimum set of the weights of the column; a 
third searching unit that searches an optimal ensemble of the weights 
of the row and the column of the low-density parity-check code via 
optimization based on Gaussian approximation, using the set of the 
5 weights of the row and the column as a fixed parameter; and a dividing 
unit that divides at random the weights of the row and the column of the 
basic matrix after deleting the rows in a predetermined procedure 
based on a final ensemble. 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a flowchart of a method of generating check matrixes 
for LDPC codes according to the present invention; Fig. 2 is a diagram 
of a matrix of selected Euclidean geometry codes EG(2, 2 2 ), Fig. 3 is a 
diagram of a matrix after a rearrangement (i.e., basic matrix); Fig. 4 is a 

15 diagram of an ensemble (provisional) of a generator function X{x) and a 
generator function p(x) after weights are distributed; Fig. 5 is a diagram 
of an ensemble (provisional) of a generator function X(x) and a 
generator function p(x) after weights are distributed; Fig. 6 is a diagram 
of an ensemble (provisional) of a generator function X(x) and a 

20 generator function p(x) after weights are distributed; Fig. 7 is a diagram 
of one example of a weight distribution adjusting table; Fig. 8 is a 
diagram of an ensemble of a final generator function X{x) and a final 
generator function p(x) after the ensemble shown in Fig. 6 is adjusted; 
Fig. 9 is a diagram of a conventional dividing procedure according to a 

25 research paper; Fig. 10 is a diagram of a basic random sequence C (i) 
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and a permutation pattern LBj (i) of the basic random sequence; Fig. 11 
is a diagram of a Latin square matrix L jq (i); Fig. 12 is a diagram of a 
relation between Eb/No (a ratio of signal power to noise power per one 
information bit) and bit error rate (BER); Frg^J^is a diagram of an 
5 LDPC encoding/decoding system; Fig ^ 1 4J s a diagram of a 

conventional check matrix for LDPC codes; Fig. 15 is a diagram of a 
configuration of Euclidean geometry codes EG(2 f 2 2 ); and Fig. 16 is an 
exemplary row weight regularly separated from 4 into 2. 

10 BEST MODE FOR CARRYING OUT THE INVENTION 

The present invention will be explained in detail with reference 
to the accompanying drawings. 

Fig. 1 is a flowchart of a method of generating check matrixes 
for LDPC codes according to the present invention. The method of 

15 generating check matrixes for LDPC codes according to the present 
embodiment can be executed within a communication apparatus 
according to a set parameter, or can be executed by other control unit 
at the outside of the communication apparatus (such as a computer). 
When the method of generating check matrixes for LDPC codes 

20 according to the present embodiment is executed at the outside of the 
communication apparatus, generated check matrixes for LDPC codes 
are stored into the communication apparatus. In the following 
embodiment, the above method is executed within the communication 
apparatus for the convenience of explanation. 

25 Prior to explanation of the method of generating check matrixes 
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for LDPC codes according to the present embodiment, the positions of 
an encoder and a decoder capable of achieving the method is 
explained first together with the conventional method of generating 
check matrixes for "Irregular-LDPC Codes". The LDPC 
5 encoding/decoding system has the same configuration as that 
previously explained in Fig. 13. 

At the sending side, the encoder 101 generates a check matrix 
H using the method of generating check matrixes for LDPC codes 
according to the present embodiment later described. Then, a 
10 generator matrix G is derived from the following condition. 

G:k*n matrix (where k is information-length and n is code-word 

length) 

GH T =0 (where T is transposition) 

The encoder 101 then receives a message (mi m 2 ... m k ) of an 
15 information-length k, and generates a code-word C using the generator 
matrix G. 

C=(m 1 rri2 ... nrik)G 

=(ci c 2 c n ) (where H(ci c 2 ... c n ) T =0) 
The modulator 102 subjects the generated code-word C to 
20 digital modulation such as BPSK, QPSK or multi-valued QAM and 
transmits the resultant modulated signal. 

At the receiving side, the demodulator 104 receives the 
modulated signal via the channel 103, and subjects it to a digital 
demodulation such as BPSK, QPSK or multi-valued QAM. The 
25 decoder 105 then subjects the LDPC-coded, demodulated result to an 
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iterative decoding by "Sum-Product Algorithm" and provides an 
estimated result (corresponding to the original ml m2 ... mk). 

Chung et al. (S. -Y. Chung, T. J. Richardson, and R. Urbanke, 
"Analysis of Sum-Product Decoding of Low-Density Parity-Check Codes 
5 Using a Gaussian Approximation," IEEE Trans. Inform. Theory, vol. 47, 
No. 2, pp. 657 to 670, Feb. 2001.) have theoretically analyzed the 
conventional method of generating check matrixes for "Irregular-LDPC 
Codes" . The method is explained here in detail. In this method, a 
"Sum-Product Algorithm" for LDPC codes is analyzed, on the 

10 assumption that a Log Likelihood Ratio (LLR) between an input and an 
output at an iterative decoder can be approximated in a Gaussian 
distribution, to derive a nice ensemble of row and column weights. 

The method of generating check matrixes for LDPC Codes 
described in the paper, or Gaussian Approximation, has a premise that 

15 defines a point of "1" on a row as a variable node and a point of "1" on 
a column as a check node in the check matrix. 

LLR message propagation from a check node to a variable node 
is analyzed first. The following equation (2) is defined on condition 
that 0<s< oo and 0<t<oo. In this case, s=mu0 denotes a mean of uO; uO 

20 a Log Likelihood Ratio (LLR) associated with a signal received via a 
channel containing a Gaussian noise of distributed value an2; and t an 
ensemble average of LLR output values at check nodes at the time of 
certain iteration. 



fj(s, t)=c(,- 1 



1-£x,<Ks + (i-1)t) 



1- 
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f(s, t)=X Pj f j (s f t) (2) 

j= 2 

A,(x) and p(x) respectively denote generator functions of degree 
distribution associated with variable nodes and check nodes, and can 
be represented by the equations (3) and (4). (A degree is expressed as 
5 the number of "1"s in each row and each column of variable nodes and 
check nodes). In addition, X\ and pi respectively denote ratios of 
edges belonging to variable nodes and check nodes at a degree of L 
Finally, dl denotes a degree of maximum variable nodes, and d r a 
degree of maximum check nodes. 

Mx) = X^ i x i - 1 

10 i-2 (3) 



p(x)=i Pi x M 

=2 



(4) 



(|)(x) is defined as the following equation (5) 



<Kx) = 



1 f , . u 



(u-x) z 



; Ltanh— e 4x du ifx>0 

Vto R 2 ,T x > u 



if x < 0 



(5) 



The equation (2) can be represented equivalently by the 
15 following equation (6) 

ti=f(s,t M ) (6) 
where ti denotes an ensemble average of LLR output. values on check 
nodes at the time of the l-th iteration. 

A condition required for deriving an SNR limit (threshold) that 
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provides an error with a value of 0 includes ti(s)^a> (expressed as R+) 
when 1-^co. In order to satisfy this condition, it is required to satisfy 
the following conditional expression (7): 

t<f(s, t), all teR+ (7) 
LLR message propagation from a check node to a variable node 
is analyzed next. The following equation (8) is defined on condition 
that 0<s<oo and 0<r<1. In this case, r has an initial value rO of 4>(s). 



hi(s, r)=<p 



s + (i-l)% Pj 0->(\-(l-ry->)\ 



J=2 



h(s, 0=^^(8,0 (8) 

=2 



10 The equation (8) can be represented equivalently by the following 
equation (9) 

ri=h(s, r M ) (9) 
A condition required for deriving an SNR limit (threshold) that 
provides an error with a value of 0 includes n(s)^0. In order to satisfy 
15 this condition, it is required to satisfy the following conditional 
expression (10) 

r<h(s, r), all re(0, <|>(s)) (10) 
In the paper by Chung et al., optimal degrees are searched for 
variable nodes and check nodes using the above equation in the 
20 following procedure (Gaussian approximation): 

(1) On the assumption that a generator function X(x) and a Gaussian 
noise an are given, a generator function p(x) is used as a variable to 
search a point that maximizes the equation (1) previously described. A 
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constraint condition associated with this search includes normalization 
to p(x)=1 and satisfaction of the equation (7); 

(2) On the assumption that a generator function p(x) and a Gaussian 
noise an are given (as a value resulted from the step (1), for example), 

5 a generator function X(x) is used as a variable to search a point that 
maximizes the equation (1). A constraint condition associated with this 
search includes normalization to ?l(x)=1 and satisfaction of the equation 
(10); 

(3) In order to find the maximum "rate", the steps (1) and (2) are 
10 iteratively executed to search a better ensemble of the generator 

function ?^(x) and the generator function p(x) with a linear programming; 
and 

(4) Finally, signal power is normalized to 1 based on Gaussian noise 
an to find an SNR limit (threshold). 

15 threshold (dB)=-10*log1o( 2 * a n) (11) 

A problem is found in the paper of Chung et al. because a check 

matrix derived from the maximum of the "rate (coding rate)" is flux. 

Such the check matrix is not suitable for practical design because the 

rate fixed in design as a spec varies. In addition, a problem is found in 

20 the paper of Chung et al. that it takes time to carry out a search 

processing because the derivation of the degree distribution associated 
with variable nodes and the derivation of the degree distribution 
associated with check nodes are executed over certain times. Further, 
it is difficult to easily cope with an optional ensemble, an optional code 

25 length, and an optional coding rate. 
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Therefore, a method of easily searching in a short time a 
definite and characteristic-stabilized check matrix for "Irregular-LDPC 
Codes" corresponding to an optional ensemble, an optional code length, 
and an optional coding rate according to the present embodiment, will 
5 be explained (see Fig. 1). Specifically, a check matrix for 

"Irregular-LDPC Codes" is generated by dividing or deleting the 
arrangement of "1s" in one row or one column in Euclidean geometry 
codes. Fig. 1 is a flowchart of the method of generating check 
matrixes for LDPC codes according to a first embodiment of the present 
10 invention. 

According to the method of generating check matrixes for LDPC 
codes according to the present embodiment, a code length N and a 
coding rate are determined (step S1). As a result, the size of the 
check matrix is determined as N*M. M can be expressed as 

15 Nx(l-rate). Therefore, when N=6000, and rate=0.5, for example, 
M=6000x0. 5=3000. 

Next, Euclidean geometry codes EG(2, 2 s ) that become a base 
of the check matrix for "Irregular-LDPC Codes" are selected (step S2). 
A row weight and a column weight become 2 s respectively. 

20 The selected Euclidean geometry codes EG(2, 2 s ) are 

rearranged such that 1 within a column is at a higher position of the 
column as far as possible (step S3). The order of this rearrangement 
is generally expressed as shown in the following equation (12) when h k 
(X)^Galois Field (2 2s ), and k={1, 2, (2 2s -1)}. 
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[(l + X wl + X w2 + . . . + jH 2 '" 1 ))- ,V (m) ] (12) 



where i=1 to 2 2s -1. The polynomial within (•) of the equation (12) 
denotes a first row of the Euclidean geometry codes EG(2 f 2 s ). 

When hj(X)=hj(X) is present in i=1 to 2 2s -1 and j=1 to 1-1, hi (X) 
5 is deleted. When a row delete processing described later (at step S6) 
is carried out by this rearrangement, a column having a largest weight 
possible can be left, and a variation of weight within the column can be 
minimized. 

For example, when s=2, that is, when Euclidean geometry 
10 codes EG(2, 2 2 ) is selected, the implementation of the above 

rearrangement procedure causes the matrix shown in Fig. 2 to be 
rearranged to a matrix shown in Fig. 3. Fig. 2 is a diagram (where 
blank designates 0) of the matrix of Euclidean geometry codes EG(2, 
2 s ) selected at step S2, and Fig. 3 is a diagram of the matrix (basic 
15 matrix) after the rearrangement. 

Next, a largest weight of a column y<[ (2<y 1 <2 s ) is selected (step 
S4). In the coding/decoding using LDPC codes, generally when the 
number of "cycle 4" and "cycle 6" is as small as possible on a binary 
graph, satisfactory characteristics can be obtained. Therefore, LDPC 
20 codes having a construction of restricting the occurrence of a small 
number of "cycle 4" and "cycle 6" is preferable. Euclidean geometry 
codes do not have "cycle 4". Therefore, decoding characteristics are 
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improved by deleting "cycle 6". For example, in the case of Euclidean 
geometry codes EG(2, 2 5 ), it is generally known that the number of 
"cycle 6" decreases when the weight is about 12, and satisfactory 
characteristics are obtained. In the example, yi = 12 is selected. 
5 Although, yi = 12 is selected in this example, other number can be 
selected when the above condition is satisfied. 

Next, an ensemble of "Irregular-LDPC codes" based on a 
requested coding rate is provisionally obtained using optimization 
according to Gaussian Approximation (step S5). A generator function 
10 p(x) of a weight distribution of row is set as p(x)= pjx j ~ 1 +(1 -pj)x j , where j 
is an integer of j>2. 

A parameter set (m, 1^2} that satisfies the following equation (13) 
is selected (step S5), where 2 <jaj<2 s , and ie{1, 2}. 

1 5 arg- min|p_// | . - p'_/i g \ 

P>,=^ (13) 

where bi and i are nonnegative integers, m denotes a row weight, and 
p_(ii' denotes an edge ratio belonging to the weight m that is matched 
with "Irregular-LDPC codes". In this example, m=8 and ja 2 =8 are 
20 selected as parameter sets. Fig. 4 is a diagram of an ensemble 

(provisional) of a generator function X{x) and a generator function p(x) 
after weights are distributed when yi=dj=12, and rate=0.5, where x 
denotes a weight, and X x and p x represent weight distributions of 
variable nodes and check nodes respectively. In the table, oqa 
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denotes a noise distribution value on the "threshold" derived by 
Gaussian Approximation; SNR n0 rm(GA) denotes a difference between 
an SNR on the "threshold" derived by Gaussian Approximation and an 
SNR on Shannon limit. 
5 Steps of executing Gaussian Approximation according to the 

present embodiment for searching an ensemble of a generator function 
X(x) of a degree distribution of variable nodes and a generator function 
p(x) of a degree distribution of check nodes will be explained. 
(1) A coding rate "rate" is fixed (step S1). 

10 (2) A generator function A,(x) and a generator function p(x) are 
simultaneously used as variables, and a linear programming is 
employed to search optimal generator functions X{x) and p(x) that 
maximize the Gaussian noise an. A constraint condition associated 
with this search includes normalization to = 1 , p(1) = 1 and 

15 satisfaction of the equation (10). 

Thus, according to the present embodiment, the linear 
programming is employed once to find such generator functions X(x) 
and p(x) that satisfy the equations (9) and (10). Therefore, it is 
. possible to search a definite and characteristic-stabilized check matrix 

20 for LDPC codes more easily in a shorter time than the method 

described in the above paper (Chung, et. al.) that iteratively executes 
derivation of the generator functions A.(x) and p(x) to derive both 
optimal values. 

When a number of rows is M' after a row division processing 
25 (step S8) explained later is executed following bi, b2, m, and \xz 
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10 



15 



20 



obtained at steps S5, the rows of the number shown in the following 
equation (14) are deleted in order from the bottom of the basic matrix 
shown in Fig. 3 (step S6). As a result, the weight set of columns of the 
matrix after the deletion becomes {di, d2, .... d a }. 

Next, an ensemble of "Irregular-LDPC Codes" based on a 
requested coding rate is provisionally obtained using optimization by 
Gaussian approximation according to the present embodiment and 
using \x\ t \i 2 , p_Hi\ and p_\JL2 as fixed parameters (step S7). For a 
specific column, when the number of column weight x becomes smaller 
than 1 , this weight js deleted from the candidate. Fig. 5 is a diagram 
of an ensemble (provisional) of a generator function X(x) and a 
generator function p(x) after weights are distributed when y^dj-12, and 
rate=0.5. 

A set {yi, y 2l yi} of column weight candidates that satisfies 
the above weight distribution and satisfies the following equation (15) is 
selected (step S7), where yi<2 s . When there is a weight of column 
that does not satisfies the following equation (15), this column weight is 
deleted from the candidates. 
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(15) 



In the above equation, each a denotes a nonnegative integer 
coefficient of {yi, y 2 , yi} that constitutes a column weight d_p (P={1, 
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2, a}, i and j are positive integers, y\ denotes a column weight, and 
Yi denotes a largest weight of column. 

Next, an ensemble of "Irregular-LDPC Codes" based on a 
requested coding rate is obtained using optimization by Gaussian 
5 approximation according to the present embodiment and using m, ji2, 
P_Hi\ and p_ji2 f and {y-i, y 2 , yi} as fixed parameters (step S7). Fig. 

6 is a diagram of an ensemble of a generator function X{x) and a 
generator function p(x) after weights are distributed when yi=dj=12, and 
rate=0.5. 

10 Prior to such the dividing process, the weight distributions in the 

ensemble of generator functions X{x) and p(x) shown in Fig. 6 are 
subjected to adjustment in the following procedures. 

The adjusting procedure will be explained using the example 
shown in Fig. 7 for the convenience of explanation, although Fig. 7 is 

15 not a table of the adjustment of weight distribution shown in Fig. 6. Fig. 

7 is a diagram of one example of a weight distribution adjusting table. 
(1) The ensemble of the generator functions ^(x) and p(x) (see Table 

1) found through Gaussian Approximation is set in the table on the 
second column and the third column. 
20 (2) The weight distributions kx and px (the third column) are 

multiplied by the total number of "1"s, TP=26688, in the entire matrix at 
EG(2, 25) to find the total weight number of weight units, and the total 
weight number of weight units and a sum thereof are set on the fourth 
column. 

25 (3) The total weight number of weight units (on the fourth column) is 
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divided by the corresponding weight of x to find the total column 
number of weight units, which is set on the fifth column. 

(4) If the total column number of weight units contains a fraction after 
the decimal point, a rounding process (such as rounding off, rounding 

5 up, and rounding down) is performed, and the rounded result is set on 
the sixth column. 

(5) The rounded total column number of weight units (on the sixth 
column) is multiplied by the corresponding weight of x to find the total 
column number of weight units after the rounding process, which is set 

10 on the seventh column. It is then determined whether each sum of the 
total column numbers (a total row on the seventh column) is equal to 
the total number of "1"s in the matrix (TP=26688). 

(6) If it is not equal to the total number of "1"s in the matrix, the 
rounded total column number of weight units (on the seventh column) is 

15 adjusted on an integer basis, and the adjusted result is set on the 

eighth column. In this case, the sum on the eighth column is adjusted 
to have a value equal to the total number of H 1"s in the matrix 
(TP=26688). 

(7) The adjusted total weight number of weight units (on the eighth 
20 column) is divided by the corresponding weight of x to find the adjusted 

total column number of weight units, which is set on the ninth column. 
Each adjusted weight distribution (on the eleventh column) is 
determined to have a value as close to the value found through 
Gaussian Approximation (on the third column) as possible. 
25 The above adjusting procedure can be generally expressed as 
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shown in the following equations (16), (17), and (18). A number of 
columns n_yj belonging to the weight yi and a number of rows n_\i\ 
belonging to the weight jas are obtained from the following equation (16), 
where w t denotes a total weight of matrixes after deleting rows. 



n_y i = round 



w, x- 



V Yi ) 



n _fj. i - round 



w t x 



(16) 



^ Mi ) 

The last number of columns n_yi' belonging to the weight yi and 
the last number of rows n_ni' belonging to the weight \x\ are obtained 
based on the following conditions ((the equations (17) and (18)). X_yi' 
10 represents a ratio of columns belonging to the weight yj' adjusted by 
matching the matrix after deleting rows, and p_jV represents a ratio of 
rows belonging to the weight m * adjusted by matching the matrix after 
deleting rows. 

n' __Yi = x ~ ~ Yi , 1=1 . 2, .... 1 

Yi 

i 

15 Ys n '-Y> = ™ t 

arg min^|/l_/. -X _y\ (17) 

7 = 1 

n'_v,=w,x£=£-, 2 
Mi 

2 
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Fig. 8 is a diagram of an ensemble of a final generator function 
X{x) and a final generator function p(x) at step S7 after the ensemble 
shown in Fig. 6 is adjusted in the following procedure. 

Lastly, a procedure of dividing one row or one column in 
5 Euclidean geometry codes (step S8) is explained. The paper of Y. Kou 
et al. proposes to perform the dividing based on certain rules. Fig. 9 
illustrates the dividing procedure proposed in the paper of Kou et al. 
As shown in Fig. 9, a matrix is numbered with column numbers 1, 2, 3 ... 
in sequence from the left end and row numbers 1, 2, 3 ... in sequence 
10 from the top. For example, 32 pointsxl row can be divided into 8 

pointsx4 rows regularly in accordance with the following equation (12) 

S m (n)=B,(m+4*n) (19) 
where m = 1, 2, 3, 4; n=0, 1, 2, 3, 4, 5, 6, 7; and I denotes a column 
number in EG(2, 2 5 ). Bi(x) denotes a position of "1" on the l-th column 
15 in EG(2, 2 5 ), and Sm(n) a position of "1" on the m-th column in the 
divided matrix. 

Specifically, a row number indicative of a position of "1" on a 
row in EG(2, 2 5 ) is represented by 

Bi(x)={1 32 114 136 149 223 260 382 402 438 467 507 574 579 
20 588 622 634 637 638 676 717 728 790 851 861 879 947 954 971 977 
979 998} 

As a result, extracting a number indicative of "1" from Bi(x) regularly, 
row numbers indicative of positions of "1" on the 1st to 4th columns in 
the divided matrix are represented by 
25 Si(n)={1 149 402 574 634 717 861 971} 



28 

S 2 (n)={32 223 438 579 637 728 879 977} 

S 3 (n)={114 260 467 588 638 790 947 979} 

S 4 (n)={136 382 507 622 676 851 954 998}. 
Thus, 32 pointsxl row can be divided into 8 pointsx4 rows. 
5 On the other hand, in the dividing procedure according to the 

present embodiment, Euclidean geometry codes are not divided 
regularly as described above. Rather, a number indicative of "1" is 
extracted from B|(x) at random. Any extracting process may be 
applied so long as it can retain randomness. 
10 Accordingly, on the m-th column in the divided matrix, an 

exemplary position of "1", R m (n), is represented by 

Ri(n)={1 114 574 637 851 879 977 979} 

R 2 (n)={32 136 402 467 588 728 861 971} 

R 3 (n)={149 260 382 438 579 638 717 998} 
15 R 4 (n)={223 507 622 634 676 790 947 954}. 

One example of the above random division, that is, the above "a 
dividing method using a Latin square of random sequences" will be 
explained in detail. A random sequence is generated easily and 
definitely for the random division. This method has an advantage 
20 because the sending side and the receiving side can generate the 
same random sequence. This is extremely important in a practical 
system. There is another advantage because a condition associated 
with code characteristics can be defined correctly. 

(1) Creation of basic random sequences: 
25 An example of random sequence creation is described below using 
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Euclidean geometry codes EG(2, 2 5 ) for convenience of explanation. 
In Euclidean geometry codes EG(2, 2 5 ), the number of "1"s present in a 
row is equal to 2 5 =32. 

When P is used for the minimum prime number that satisfies 
5 P>2 S , for example, P=37 in the case of 2 5 . A basic random sequence 
C(i) with a sequence length, P-5=32, is created in accordance with the 
equation (20) 
C(1)=1 

C(i+1)=G0xC(i) mod P (13) 
10 where i=1, P-1; and GO denotes an original source of Galois Field 
GF(P). As a result, C(i) is represented by: 

C(i)={1 2 4 8 16 32 27 17 34 31 25 13 26 15 30 23 9 18 36 35 
33 29 21 5 10 20 3 6 12 24 11 22 7 14 28 19} 

(2) Numbers larger than 32 are deleted such that a sequence 
15 length becomes 2 5 =32. 

C(i)={1 2 4 8 16 32 27 17 31 25 13 26 15 30 23 9 18 29 21 5 10 
20 3 6 12 24 11 22 7 14 28 19} 

(3) A skip interval S(j) is defined as shown in the following 
equation (21) in order to read the basic random sequence at a constant 

20 interval. 

S(j)=j 2, 2 s (21) 

(4) A permutation pattern LB j (i) is generated based on the 
following equation (22). 

LBj(i)=((S (jjxi) mod P)+1 
25 j-1, 2, 2 s 
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2 f P-1 (22) 
Numbers of LB j (i) larger than 2 s are deleted. Fig. 10 is a diagram of a 
basic random sequence C (i) and a permutation pattern LBj (i) of the 
basic random sequence. 
5 (5) A Latin square matrix Lj q (i) that is a j-th matrix of q columns 

and i rows is calculated based on the following equation (23), thereby 
executing a divide processing. In this case, when the column weight 
d_p is d_(3<2 s by the divide processing at step S6 f numbers larger than 
d_p are thinned out from the elements of L jq (i). 
10 L jq (i)=LBj(((q + i-2) mod 2 S )+1) 

j=1, 2, 2 s 
2, 2 s 

q=1,2, •-, 2 s (23) 
Fig. 11 is a diagram of a Latin square matrix L jq (i). This Latin 

15 square matrix L jq (i) is used to determine a j*32+q-th division pattern of 
a matrix to be expanded. For example, the 670-th column g 6 7o (1)={28 
48 84 113 153 220 225 234 268 280 283 284 322 363 374 436 497 507 
525 593 600 617 623 625 644 670 701 783 805 818 892 929} of a 
shortened EG(2,25) by deletion is set to g 6 7o (1)- This is divided into 

20 five columns of a weight 6 and one column of a weight 2. Because a 
corresponding Latin square L jq (i) becomes L 2 i,3o 20x32+30=670, 
L 2 1,31={13 19 9 10 16 24 25 28 23 5 8 12 31 14 30 21 4 6 17 7 15 29 2 
3 27 22 26 18 1 20 32 11} 
As a result, the divided patterns are as follows 

25 . g 6 7o. i(1)=g67o(L 2 i, 30(1)) 
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={322 525 268 280 436 625} i=1, 2, 6 

g670, 2(1)= g670(L 2 1, 30(1)) 

={644 783 623 153 234 284} i=7, 8, 12 

g670, 3(1 )= g670(L 2 1, 30(1)) 

5 ={892 363 818 600 113 220} i=13, 14, 16 

g670, 4(1 ) = g670(L 2 1, 30(1)) 

={497 225 374 805 48 84} i=17, 18, 24 

9670, 5(1) = g670(L 2 1,30(1)) 

={701 617 670 507 28 593} i=25, 26, 30 

10 g 6 70, 6(1 ) = g670(L 2 1, 30(1)) 

={929 283} i=31, 32 
Characteristics of the LDPC codes previously described are 
compared below. Fig. 12 is a diagram of a relation between Eb/No (a 
ratio of signal power to noise power per one information bit) and bit 

15 error rate (BER). The decoding method is a "Sum-Product Algorithm". 
The characteristics use the ensemble shown in Fig. 8. Fig. 12 is a 
comparison of characteristics between a result of a regular division as 
described in a research paper by Y. Kou et al. and a result of executing 
a divide processing according to a Latin square in random sequence. 

20 As is clear from Fig. 12, when the division method according to 

the present embodiment is used, the result of executing a divide 
processing according to a Latin square in random sequence comes 
close to about 1.2 decibel of Shannon limit. According to a regular 
division as described in a research paper by Y. Kou et al., a large 

25 improvement cannot be expected even with "Irregular-LDPC Codes". 
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In contrast, the random division of the present embodiment can provide 
a remarkably improved performance when it is implemented because 
the probability of the occurrence of a loop decreases substantially. 

As explained above, according to the present embodiment, first 
5 a code length and a coding rate are determined. Next, Euclidean 
geometry codes that become a base are determined. The selected 
Euclidean geometry codes are rearranged based on a specific 
relational equation to create a basic matrix. A maximum value of a 
column weight that satisfies the condition "2<yi^2 s " is selected. In a 

10 state that row weights are limited to continuous two kinds, an ensemble 
of Irregular-LDPC codes is searched by Gaussian approximation. An 
optimum set of row weights is determined. Rows are deleted in order 
from the bottom of the basic matrix by considering the number of rows 
after a division. An ensemble of Irregular-LDPC codes is provisionally 

15 searched by Gaussian approximation using a set of row weights. An 
optimum set of column weights is determined. An optimal ensemble of 
Irregular-LDPC codes is searched by Gaussian approximation using the 
set of row weights and the set of column weights as fixed parameters. 
Finally, weights of the rows and columns of the basic matrix after 

20 deleting the rows are divided at random in a predetermined procedure 
based on this ensemble. As a result, a definite and 
characteristic-stabilized check matrix for "Irregular-LDPC Codes" 
corresponding to an optional ensemble, an optional code length, and an 
optional coding rate can be easily generated in a short time. 

25 While Euclidean geometry codes are used to generate check 
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matrix for "Irregular-LDPC Codes" according to the present 
embodiment, firm "Irregular-LDPC codes" can be constructed using a 
Cayley graph, for example. In this case, "processing of determining 
weights of rows and columns of the Cayley graph as a base, thereby 
5 creating a basic matrix" is executed in place of the above-explained 
"processing of selecting Euclidean geometry codes EG that become a 
base (step S2)" and "processing of rearranging the selected Euclidean 
geometry codes based on the equation (12), thereby creating a basic 
matrix (step S3)". Other processing are similar to the processing 

10 shown in Fig. 1 . 

Therefore, when the Cayley graph is used, a similar effect can 
be obtained by taking the same procedure as that explained above. A 
Magulis construction method and a Ramanujan graph construction 
method are available for the Cayley graph as shown in "J. Rosenthal, 

15 P.O. Vontobel, "Construction of LDPC codes using Ramanujan graphs 
and ideas from Margulis," in Proc. of the 38-th Allerton Conference on 
Communication, Control, Computing, 2000, pp. 248-257". 

While Euclidean geometry codes or the Cayley graph are used 
for the basic matrix in the above explanation, other matrixes than 

20 Euclidean geometry codes such as projective geometric codes can be 
used so long as the matrixes satisfy conditions that "weights of rows 
and columns are constant" and "number of cycles is equal to or more 
than 6". 

As explained above, according to one aspect of the present 
25 invention, first a code length and a coding rate are determined. Next, 



34 

Euclidean geometry codes that become a base are determined. The 
selected Euclidean geometry codes are rearranged based on a specific 
relational equation to create a basic matrix. A maximum value of a 
column weight is selected. In the state that row weights are limited to 
5 continuous two kinds, an ensemble of Irregular-LDPC codes is 

searched by Gaussian approximation. An optimum set of row weights 
is determined. Rows are deleted in order from the bottom of the basic 
matrix by considering the number of rows after a division. An 
ensemble of Irregular-LDPC codes is provisionally searched by 

10 Gaussian approximation using a set of row weights. An optimum set of 
column weights is determined. An optimal ensemble of Irregular-LDPC 
codes is searched by Gaussian approximation using the set of row 
weights and the set of column weights as fixed parameters. Finally, 
weights of the rows and columns of the basic matrix after deleting the 

15 rows are divided at random in a predetermined procedure based on this 
ensemble. As a result, there is an effect that a definite and 
characteristic-stabilized check matrix for "Irregular-LDPC Codes" 
corresponding to an optional ensemble, an optional code length, and an 
optional coding rate can be easily generated in a short time. 

20 According to another aspect of the present invention, the 

weights in the matrix are rearranged to be disposed at a higher position 
in columns. With this arrangement, there is an effect that columns of 
large weights can be left and a variation of weights within columns can 
be reduced at the time of deleting rows. 

25 According to still another aspect of the present invention, first a 
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code length and a coding rate are determined. Next, weights of rows 
and columns of a Caylay graph that become a base are determined. A 
maximum value of a column weight is selected. In the state that row 
weights are limited to continuous two kinds, an ensemble of 
5 Irregular-LDPC codes is searched by Gaussian approximation. An 
optimum set of row weights is determined. Rows are deleted in order 
from the bottom of the basic matrix by considering the number of rows 
after a division. An ensemble of Irregular-LDPC codes is provisionally 
searched by Gaussian approximation using a set of row weights. An 

10 optimum set of column weights is determined. An optimal ensemble of 
Irregular-LDPC codes is searched by Gaussian approximation using the 
set of row weights and the set of column weights as fixed parameters. 
Finally, weights of the rows and columns of the basic matrix after 
deleting the rows are divided at random in a predetermined procedure 

15 based on this ensemble. As a result, there is an effect that a definite 
and characteristic-stabilized check matrix for "Irregular-LDPC Codes" 
corresponding to an optional ensemble, an optional code length, and an 
optional coding rate can be easily generated in a short time. 

According to still another aspect of the present invention, the 

20 generator function X(x) and the generator function p(x) are calculated in 
one linear programming. Therefore, it is possible to search a definite 
and characteristic-stabilized check matrix for LDPC codes more easily 
and speedily than the method described in the research paper that 
iteratively executes derivation of the generator functions X(x) and p(x) 

25 to derive both optimal values. 
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According to still another aspect of the present invention, a 
weight distribution is adjusted such that the total weight number of 
weight units is equal to an integer, and a sum of the total weight 
numbers of weight units is equal to the total number of "1"s in 
5 Euclidean geometry codes. There is an effect that this realizes more 
accurate dividing process. 

According to still another aspect of the present invention, a 
condition associated with code characteristics can be defined correctly 
through creation of a Latin square of random sequences. 

10 According to still another aspect of the present invention, first a 

code length and a coding rate are determined. Next, Euclidean 
geometry codes that become a base are determined. The selected 
Euclidean geometry codes are rearranged based on a specific 
relational equation to create a basic matrix. A maximum value of a 

15 column weight is selected. In the state that row weights are limited to 
continuous two kinds, an ensemble of Irregular-LDPC codes is 
searched by Gaussian approximation. An optimum set of row weights 
is determined. Rows are deleted in order from the bottom of the basic 
matrix by considering the number of rows after a division. An 

20 ensemble of Irregular-LDPC codes is provisionally searched by 

Gaussian approximation using a set of row weights. An optimum set of 
column weights is determined. An optimal ensemble of Irregular-LDPC 
codes is searched by Gaussian approximation using the set of row 
weights and the set of column weights as fixed parameters. Finally, 

25 weights of the rows and columns of the basic matrix after deleting the 
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rows are divided at random in a predetermined procedure based on this 
ensemble. As a result, there is an effect that a definite and 
characteristic-stabilized check matrix for "Irregular-LDPC Codes" 
corresponding to an optional ensemble, an optional code length, and an 
5 optional coding rate can be easily generated in a short time. 

According to still another aspect of the present invention, first a 
code length and a coding rate are determined. Next, weights of rows 
and columns of a Caylay graph that become a base are determined. A 
maximum value of a column weight is selected. In the state that row 

10 weights are limited to continuous two kinds, an ensemble of 

Irregular-LDPC codes is searched by Gaussian approximation. An 
optimum set of row weights is determined. Rows are deleted in order 
from the bottom of the basic matrix by considering the number of rows 
after a division. An ensemble of Irregular-LDPC codes is provisionally 

15 searched by Gaussian approximation using a set of row weights. An 
optimum set of column weights is determined. An optimal ensemble of 
Irregular-LDPC codes is searched by Gaussian approximation using the 
set of row weights and the set of column weights as fixed parameters. 
Finally, weights of the rows and columns of the basic matrix after 

20 deleting the rows are divided at random in a predetermined procedure 
based on this ensemble. As a result, there is an effect that a definite 
and characteristic-stabilized check matrix for "Irregular-LDPC Codes" 
corresponding to an optional ensemble, an optional code length, and an 
optional coding rate can be easily generated in a short time. 



25 
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INDUSTRIAL APPLICABILITY 

As explained above, the method of generating check matrixes 
for LDPC codes and the check matrix generating apparatus according 
to the present invention are useful for a communication apparatus that 
employs LDPC codes as error correcting codes, and are particularly 
useful for an apparatus that generates a definite and characteristic 
stabilized "Irregular-LDPC codes". 



